Boosting Density Estimation
نویسندگان
چکیده
Several authors have suggested viewing boosting as a gradient descent search for a good fit in function space. We apply gradient-based boosting methodology to the unsupervised learning problem of density estimation. We show convergence properties of the algorithm and prove that a strength of weak learnability property applies to this problem as well. We illustrate the potential of this approach through experiments with boosting Bayesian networks to learn density models.
منابع مشابه
Kernel density classification and boosting: an L2 analysis
Kernel density estimation is a commonly used approach to classification. However, most of the theoretical results for kernel methods apply to estimation per se and not necessarily to classification. In this paper we show that when estimating the difference between two densities, the optimal smoothing parameters are increasing functions of the sample size of the complementary group, and we provi...
متن کاملKernel Density Classification and Boosting
Kernel density estimation is a commonly used approach to classification. However, most of the theoretical results for kernel methods apply to estimation per se and not necessarily to classification. For example, in estimating the difference between two densities, we show that the optimal smoothing parameters are increasing functions of the sample size of the complementary group. A relative newc...
متن کاملOn boosting kernel density methods for multivariate data: density estimation and classification
Statistical learning is emerging as a promising field where a number of algorithms from machine learning are interpreted as statistical methods and vice–versa. Due to good practical performance, boosting is one of the most studied machine learning techniques. We propose algorithms for multivariate density estimation and classification. They are generated by using the traditional kernel techniqu...
متن کاملBoosting Kernel Density Estimates: a Bias Reduction Technique?
SUMMARY This paper proposes an algorithm for boosting kernel density estimates. We show that boosting is closely linked to a previously proposed method of bias reduction and indicate how it should enjoy similar properties. Numerical examples and simulations are used to illustrate the findings, and we also suggest further areas of research.
متن کاملObject Detection and Segmentation using Discriminative Learning
Jingdan Zhang: Object Detection and Segmentation using Discriminative Learning. (Under the direction of Leonard McMillan.) Object detection and segmentation algorithms need to use prior knowledge of objects’ shape and appearance to guide solutions to correct ones. A promising way of obtaining prior knowledge is to learn it directly from expert annotations by using machine learning techniques. P...
متن کامل